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ABSTRACT 



A method for use of IN-service Non- intrusive measuring 
Device (INMD) for proving Service Level Agreements 
(SLAs) and pro -active maintenance in IP telephony net- 
works is described. The INMD is currently used only in 
connection oriented TDM telephony networks and therefore 
cannot be used directly in the cormectionless- featured IP 
telephony networks. The method for use of INMD to mea- 
sure voice transmission quality in IP telephony networks 
include a set of pre-processes for processing IP voice 
datagrams, and converting the pre-processed datagrams to a 
format suitable for INMD before the INMD evaluates data 
in the datagrams for voice COS. Various tests and 
co-processes are also used to determine network perfor- 
mance parameters. An IP telephony measurement apparatus 
for practicing the method is also described. A method for 
calibrating the device and algorithms is also provided to 
ensure a high level of confidence in the measurement 
accuracy. 

42 Claims, 5 Drawing Sheets 
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METHOD AND APPARATUS FOR that are both measurable and meaDingful for both an end 

MEASURING VOICE GRADE OF SERVICE user and a service provider. 

IN AN IP NETWORK At the present time, there are no IP telephony standards 

regarding apparatus and network performance. Until the IP 
5 telephony industry matures to require apparatus and network 

TECHNICAL FIELD performance guidelines and standards, the performance of IP 

The invention relates generally to Enternel Protocol (IP) telephony will be highly dependent upon the implementa- 

telephony and, in particular, to measurements of voice grade ^i^n of voice gateways and [P network performance, 

of service (COS) for voice over IP (VoIP) in IP networks. Therefore, meaningful and accurate measurement of voice 

10 GOS must take into account the performance impact of the 

BACKGROUND OF THE INVENTION IP telephony apparatus and the IP network. In this regard, 

* u 1 f -J- LT J • * • there exists a need for a method of calibrating an IP 

The technology for providing pubhc and pnvate voice , , . . , . , ^ - . . , „ ; 

service via the Internet is rapidly maturing. At present, this 'f^Phoay apparatus and carrier ne^vork to an initial "good 

technologycomprisesIPvoicegatcwaysandyorlPtelephony ^^^""^ commissioned for telephone service 

enabled terminals connected over legacy IP networks. Qual- ^' 

ity of service (QOS) enabled IP networks for real-time SUMMARY OF THE INVENTION 
services are expected to be deployed in the near future. This 

advance in IP technology will effectively result in opening ^ object of the invention is to provide a non-intrusive 

the telephony markets to Internet service providers (ISPs), 20 "^^^^"'ig method and apparatus to assess an end-to-end IP 

and the like. Consequently, regulatory agencies will telephony network transmission quality, 

undoubtedly require that Service Level Agreements (SLAs) Another object of the invention is to provide a method and 

with customers be proven. apparatus which make use of an In-service Non-intrusive 

At the present time, the telecom industry uses In-service Measurement Device (INMD) adapted for a connection 

Non-intrusive Measuring Devices (INMD or NIM) for prov- 25 oriented Time Division Multiplexer (TDM) in an IP tele- 

ing SLAs and for pro-active maintenance of their voice phony network for measurement of IP telephony transmis- 

networks, both access and transmission facilities. ANSI sion quality. 

standard T.221, Operations, Administration, Maintenance Yet another object of the invention is provide a method 

and Provisioning (OAMP) In-service Non-intrusive Mea- and apparatus for measuring a voice Grade of Service (GOS) 

surement Device (INMD) voice service measurements are 30 and relating IP telephony network performance to the voice 

used in connection oriented TDM networks for this purpose. GOS to prove a Service Level Agreement (SLA), and for use 

The ANSI standard specifies interface, measurement range in network maintenance, 

and accuracy requirements for measuring voice-grade trans- A further object of the invention is to provide a method for 

mission parameters The standard also describes optional calibration of the apparatus and measurement algorithms 

functions associated with these parameters, and measure- 35 associated therewith 

ment algorithms that have been verified to meet the accuracy t« * <; *u ■ j 

. ^ , o , J , ^ , . - i In accordance with one aspect of the mvention, a method 

requirements of the standard for the measurement of speech t • kt • * • • ■ 

, , . , J 1 J. ~ , A . for using In-service Non-intrusive Measurmg Devices 

level noise, echo path delay and mformation loss. Apparatus AM\yrn\ «p o • • 1* ■ r * 

thatembodythisstandardLcommonlyidentifieda^INMD nl.Tt T ^ .^l^^^^y 

devices. The use of INMD measurement results for predict- 40 l ^ ^ T compnsmg steps: 

ing customer opinion performance (%GOB), which is also ^) collectmg a group^of IP datagrams of a speech sample 

called grade of service (GOS), is specified in a document of end-to-end IP telephony connection from at least 

AlUance Telecommunications Industry Solutions (AHS), ""^^ interface point by identifying a packet flow 

which is a draft proposed standard Tl LB 566 "in-service associated with an IP telephony session; 

non-intrusive measurement device (INMD) methodology 45 ^) Processing the IP datagrams and converting the same 

for applying INMD parameters to grade of service models", i"*^ ^ format suitable for INMD process; 

In order to compete with incumbent long distance tele- ^) ^^i^g INMD process to assess a plurality of voice 

phone carriers for market share, VOIP providers will require g^^^f performance parameters related to the telephony 

some mechanism to prove voice quality and network per- session. 

formance. There therefore exists a need for a metiiod and 50 Preferably, the assessment of the voice grade performance 

apparatus for measuring voice grade of service in an IP includes computing a voice Grade Of Service (GOS) per- 

network. No such apparatus is currently known to be formance using a meUiod specified in ATSI Tl LB 566. 

available, however, and known INMD devices cannot be method preferably further comprises a step: 

used to measure VOIP quality for several reasons. First, the 4) calculating a percent Good or Better (%GOB) score 

surveillance interface points specified by the INMD stan- S5 relevant to the voice GOS performance, 

dards are particular and hence restricted to connection The method may further comprise a step of: 

oriented time division multiplexed (TDM) networks. It is 5) correlating the voice GOS performance to the IP 

desirable to exploit the connectionless nature of an IP network performance. 

telephony network to provide flexibility in locating the Preferably, the method in step 1 further comprises using 
surveillance apparatus. Second, the need for tiie method and so header information in the IP datagrams to smooth out any 
apparatus for measuring voice grade of service in an IP delay variation in the speech sample and computing a group 
network also arises from the difference in performance and of network performance parameters based on the IP data- 
parameters between connection and connectionless net- gram header information. 

works. In that regard, the required method should include In a preferred embodiment, step 2 further comprises 

measuring and correlating of IP network performance 65 determining a speech compression algorithm used in the IP 

parameters such as packet loss, delay and delay variation to datagrams by examining data encapsulated in the packets, 

voice grade performance and result in a set of parameters The IP datagrams of the speech sample may be collected 
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respectively at a far end IP interface point and a near end IP by voice gateways and any additional processes can be 

interface point. provided through software. 

In accordance Avith another aspect of the invention, an 

apparatus for assessment of IP telephony networks trans- BRIEF DESCRIPTION OF THE DRAWINGS 

mission quahty comprises: 5 invention will now be further explained by way of 

an In-service Non-intrusive Measurement Device example only and with reference to the following drawings, 

(INMD) adapted to assess voice grade performance in wMch: 

parameters in a connection oriented Time Division piG. 1 is a block diagram of an ANSI T1.221 INMD for 

Multiplexer (TDM); ^^^^ telephony known in the prior art; 

a processor adapted to convert a grotip of IP datagrams i" p^j. 2 is a block diagram of an embodiment of the 

associated with an end-to-end IP te ephony connection -^^^^^^^ ^j^^^ measurement apparatus for an IP tele- 

to a data format suitable for input lo the INMD; and p^o^y n^^ork which arc co-located in voice gateways; 

a connection to the INMD for transferring the IP data- ^rr- a • ui i j- c .u ... . r 

. ixri>rr>. c . c - j ^IG- 3 IS 3 blocK diagram of another embodiment of the 

grams to the INMD for assessment of the voice grade • u - * . r « rr^ 

^ - 15 invention, showing a measurement apparatus for an all-IP 

mf ^ r t_i i:.'^t. • n telephonv nctwork which is a staud-alone devicei 

The apparatus preferably further composes a data CO Ilec- j * u 

tor to collect the IP datagrams by identifying a packet flow ^ ^ ^^Sram of processes performed by the 

associated with an IP telephony session. apparatus shown m FIG. 3 and FIG. 4; 

The INMD preferably includes a function of computing a ^IG. 5 is a block diagram of a configuration for calibra- 

voice Grade Of Service (GOS) performance specified in ^he apparatus shown in FIGS. 3 and 4; 

ATSI Tl LB 566. Preferably, the apparatus may be selec- FIG. 6 is a block diagram of a configuration for calibra- 

tively co-located with a Personal Computer (PC) based IP tion of a voice gateway to determine the performance factor; 

voice gateway or stand-alone in the end-to-end IP telephony and 

connection. Also the apparatus preferably comprises a pro- FIG. 7 is a graph illustrating a concept of relating network 

cessor to correlate the voice GOS performance to IP network ^ performance to GOS. 
performance. The processor preferably comprises a Digital 

Signal Processor (DSP) to facihtate the computation. DETAILED DESCRIPTION OF THE 

In accordance with a third aspect of the invention, an PREFERRED EMBODIMENT 

initial calibration process for calibrating an IP telephony The invention uses ANSI standard TL221 OAM&P 

measurement apparatus comprising the steps of: irvTMD Voice Service Measurements and Alliance Telecom- 

1) creating an IP datagram calibration file using speech munication Industry Solutions (APIS) draft proposed stan- 
samples having a known GOS; dard Tl LB 566 "INMD Methodology for Applying INMD 

2) processing IP datagrams from the IP datagram calibra- Parameters to Grade of Service Models", to provide a 
tion file using the IP telephony measurement apparatus 35 method and an apparatus for measuring the quality of voice 
to convert the IP datagrams into data in a format transmissions over IP networks and to predict customer 
suitable for INMD processing; opinions of performance. 

processing the data using INMD functionality of the IP FIG. 1 shows the type of interface (measurement access 
telephony measurement apparatus to determine a GOS points) specified in the ANSI and ATIS standards, including 
value associated with the IP datagrams; 40 wire analogue interfaces 20 for baseband voice and data 
comparing the GOS value with a GOS associated with the transport interfaces 22 specified in International Telecom- 
speech samples used to create the IP datagram calibra- munications Union (ITU) recommendation M.3010 which 
tion file; and covers interfaces including Tl and El. The incident speech 
adjusting the IP telephony measurement apparatus until P^^ ^^ho path are illustrated as well. The INMD can 
the GOS values are equal, within a certain predefined 45 also be configured to detect call progress states via a 
limit. Signalling System 7 (SS7) which is not shown. The tech- 
Preferably, the calibration IP datagrams are created from nology of using INMD 24 illustrated in FIG. 1 is well known 
an IP telephony terminal during a calibration operation with ^® ^^^^ connection oriented TDM telecommunica- 
a speech sample of known GOS and the output is a resultant Hons. That methodology is adapted to the field of IP tele- 
GOS value. The comparison therefore may be conducted so phony networks to provide a method and apparatus in 
between the resultant GOS value and the known GOS of the accordance with the invention. 

speech sample, FIG. 2 shows two IP telephony measurement apparatus 32 

This invention permits the IP telephony industry to mea- which embody the ANSI T1.221 standard. The apparatus 32 

sure a quality of the service they offer to their clients. Such are interfaced into an IP telephony network. In this 

a capability will provide not only a measure of voice GOS, 55 embodiment, a far-end and a near-end public switched 

but also a method of relating IP network performance to telephone network (PSTN) respectively interface into the IP 

voice SLAs, which provides Internet Service Providers network 26 through voice gateways 30. The IP telephony 

(ISPs) and Internet backbone network providers with guide- measurement apparatus 32 are incorporated in each of the 

Unes for relating voice performance to network parameters voice gateways. The apparatus 32 comprises software pro- 

that are both measurable and meaningful. eo cesses that are executed as "batch programs" and may also 

The invention exploits the connectionless nature of an IP use hardware such as a Digital Signal Processor (DSP) to 

telephony network in that the apparatus can be co-located in facilitate computation. At each end, the Signalling System 7 

a voice gateway or deployed as a stand-alone apparatus, (SS7) signalhng network 36 also interfaces with the voice 

remote from a central location. The stand-alone apparatus gateway 30 and PSTN 28 to permit detection of call progress 

would be required in an all-IP network scenario. 65 states. 

Additionally, the invention takes advantages of the fact that Another embodiment of the IP telephony measurement 

most of the processes of the invention are already provided apparatus 32 is a stand-alone configuration illustrated in 
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FIG. 3. The IP telephony measurement apparatus 32 is timestamp to smooth out delay variation in the speech 

interfaced in an "all IF* telephony connection. An IP tele- samples, which delay variation (jitter) is incurred in routing 

phony terminal device 38 at each end interfaces directly with and switching apparatus during transfer through the IP 

the Internet 34 via ISPs 40 instead of voice gateways 30. The network; 

most common IP telephony enabled terminal devices 38 are 5 4. At the far-end IP interface point, collecting parameters 
personal computers with related IP telephony software and related to network performance in terms of delay, packet- 
hardware. Consideration for a location of the IP telephony joss and jitter relevant to a particular end-to-end IP tele- 
measurement apparatus 32 is the access to IP datagrams for phony connection, the parameters computed being based on 
a circuit to be monitored. It can be located at any point in the the sequence number, timestamp and length information 
IP network where the IP datagrams are reliably collected. 10 included in the RTP header information; 

The IP telephony measurement apparatus 32 in the 5. At the far-end IP interface point stormg the timestamp 

embodiments described above generally comprises the fp^ post correlation analysis; 

INMD 24 and software for pre-processing the IP datagrams ^ ^^^.^^^ jp .^^J^^^ -^^ determining a speech 

collected from the IP telephony network and converting compression algorithm used to create the voice data, by 

S?."^! T ^ T ^^^^^ ^IZ TM^fxf..^ T taking the H.323 frame 42 encapsulated data and processing 

IS specified by ANSI TL221 for ^^e data in the DSP 50, the most common speech compres 

IP^D processmg xn regard to mstantaneous speech amph- ^-^^ algorithms being G.711, G.723.1 and G.729A; 
tude in volts. A Digital Signal Processor may also be „ , . , , , 

included to facihtate the processing. The INMD in the IP ^' ^^I^S smoothed-out compressed speech data and 
telephony measurement apparatus 32 then processes the 20 converting it to a format specified for INMD processing; 
converted datagrams as it does in a connection oriented ^- the near-end interface point, repeating steps 1 

TDM telephony network to compute the GOS and other through 7; 

related network performance parameters. 9. Computing, by INMD from the data prepared in steps 

IP telephony measurement apparatus 32 performs a plu- ^^^^^^ S""^^^ performance parameters including 

rality of processing functions illustrated in FIG. 4. First, the ^ speech level, noise, echo and echo path delay, the far-end 

IP telephony measurement apparatus performs a DSP pro- parameters being used to compute speech level and noise, 
ccssing functioii 50 in which a Digital Signal Processor the near^nd data being used to compute echo path 

(DSP) may be used to facilitate the processing of IP voice ^^^^y 

datagrams. The IP voice datagrams include packet header 10- Calculating, guided by ATSI Tl LB 566, percentage 

information such as source address, destination address and good or better (%GOB) scores related to voice GOS from 

timestamp, and network performance information such as results of step 9; 

packet loss, delay and jitter can be derived using the packet 11. Reporting the result from step 10 for SLA and 

header information. The protocol types of the IP voice Maintenance or for input of Correlation Processing, 
datagrams are generally an H.323 frame 42 encapsulated in Co-processes may be involved in step 7 of the above 

Real-time Transport Protocol (RTP) frame 44 encapsulated ^ process, depending on the IP telephony processes that need 

in User Datagram Protocol (UDP) packet 46 encapsulated in to be taken into account. The most common of the 

IP datagram 48. The DSP processing will be described below co-processes is error mitigation to remove the effects of error 

in detail with reference to a method associated with the IP and packet loss. Another process is insertion of background 

telephony measurement apparatus 32 for measuring voice noise during silent periods. 

GOS in the IP network. The DSP processing function ^ Co-processes may also be involved in step 9, depending 
converts the processed data into the format specified for the IP telephony connection. The most common of the 

INMD processing. The IP telephony measurement apparatus co-processes in this step are active speech detection, tone 

32 also mcludes an ANSI T1.221 INMD processing function detection, double-talk detection and echo cancellation. 
52 to process the converted data and to output voice per- 1* • u j j-ar 1. . . r j-rc 

f A t Tu iT>* ^ u * 45 It IS both necessary and difl&cult to account for differences 

rormance data. The IP telephony measurement apparatus 32 • 1 , c in * 1 u * j m 

ft . 1 J ATCT T^i r n c*:/c • ^ iH implementations of IP tclephooy voicc gatcways and IP 

further includes an ATSI Tl LB 566 processmg function 54 .11: ui j * • 1 1 * j . *t 

* 4 ■ r^/^c _f f *L - _r telephony enabled termmals, as related to the measurement 

to compute voice GOS performance from the voice perfor- c - j _f o * *l 

«,o«™\ioto u., iu^ TXTTvjrn a \* a accuracy of voice grade performance. Some of the main 

mance data processed by the INMD, and a report and . , ... 1 ^ * j • .l j 1 

correlation processing function 56 to prove an SLA and ^pl*'"^'^^^'* differences re ate to reduong path delay, 
provide data for maintenance. ^0 poor network performance miUgation techniques and echo 

. , , . . . ^„ „ cancellation. All these factors should be accounted for and 

Amcthod for measuring voice GOS associated with the IP addressed by a method described below. The method is 

telephony measurement apparatus 32 comprises the follow- generally based on a performance factor that relates a 

mg steps. difference in performance between the measurement appa- 

1. At the far-end IP interface point, the Internet protocol 55 ratus being calibrated and a calibration standard. 

(IP) voice datagrams of a particular end-to-end IP telephony Th^ measurement apparatus and algorithms for measuring 

connecuon are collected by recognizing the flow and pro- ^^^^ analogue parameters require calibration. FIG. 5 shows 

tocol types. As noted above the most common protocol ^ calibration configuration which uses a voice IP network 

stack bemg an H.323 frame 42 encapsulated in Real-Ume ^et-up. The measurement apparatus 32 interfaces with the 

Transport Protocol (RTP) frame 44 encapsulated m User end-to-end known good voice network between two known 

Datagram Protocol (UDP) packet 46 encapsulated m IP g^od voice gateways 58 at the respective ends. The speech- 

a agram 4«, source-to-gateway interface 60, voice analogue interface 20 

2. At the far-end IP interface point, storing IP source and and two-to-four wire interface 62 all are known to be in good 
destination address information and a timestamp for post condition. The method of calibration involves measuring 
correlation analysis; 65 gqS ratings with the IP telephony measurement apparatus 

3. At the far-end IP interface point, using the RTP frame 32 using a voice IP network set-up known to produce good 
44 header information including sequence number and results. Various tests exercise the complete range of speech 
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quality parameters, such as speech level, echo path, noise, 
etc. as per ANSI T1.221 standard. Before calibration begins, 
an IP datagram calibration file is produced using a known 
good IP telephony terminal apparatus. The IP datagram 
calibration file consists of IP datagrams output by the IP 
telephony terminal apparatus using an input speech source 
64 of a known GOS. The speech source 64 is the recom- 
mended speech samples specified by the ANSI standard. The 
IP datagram calibration file is used as an input to calibrate 
the IP telephony measurement apparatus 32. The test cases 
are also specified by the ANSI standard. During the calibra- 
tion process, the GOS values are stored in a GOS rating file 
68. When the resultant GOS values match GOS values 
associated with the recommended speech samples within 
hmits specified by the ANSI standard, the calibration is 
within acceptable limits of accuracy. 

FIG. 6 illustrates one embodiment of a configuration for 
verifying a voice gateway. After the IP telephony measure- 
ment apparatus 32 is calibrated in the above known good IP 
network set-up, the IP telephony measurement apparatus 32 
may be used, in conjunction with the IP datagram calibration 
file created during the initial phase of the calibration process 
described above to verify other voice gateways 30. Persons 
skilled in the art will understand that the principle of the 
calibration is the same as the calibration of the IP telephony 
measurement apparatus 32 described above, even though the 
apparatus tested is a voice gateway 30. 

The method for calibrating the IP telephony measurement 
apparatus 32 and algorithms for measuring voice analogue 
parameters comprises a process which includes the follow- 
ing steps: 

1. Creating an IP datagram calibration file including IP 
datagrams from an IP telephony terminal apparatus created 
during a calibration operation with speech samples of a 
known GOS; 

2. Inputting the IP datagrams of the IP datagram calibra- 
tion file through step 1 through step 10 of the method for 
measuring voice GOS described above; 

3. Comparing the value of the voice GOS resulting fram 
the previous step with the GOS value for initial speech 
stored in the IP datagram calibration file and determining 
that the IP telephony measuring device 32 is accurate if the 
two GOS values match within limits for accuracy specified 
by ANSI Tl. 221. 

TTie calibration process may also be used for commis- 
sioning an IP telephony network and related apparatus as 
reliable. The method is similar to the process described 
above. The calibration source used (either speech or IP 
datagram file) depends on the network under calibration. 
The result of the calibration process is a performance-factor 
describing the degree of similarity for GOS between the 
network being caUbrated and the GOS of the input speech 
sample. 

In regard to the method for correlating voice GOS to 
network performance, the method includes the following 
steps: 

1. Tabulating all the performance particulars for measur- 
ing end-to-end voice connections as determined by source/ 
destination address pairs. The particular parameters are 
analogue voice performance, voice GOS and IP network 
performance such as packet loss, delay and jitter; 

2, Using the tabulated data to look for correlations 
between networic performance parameters and analogue 
voice parameters. The purpose of which is to verify SALs 
and for maintenance purposes. 

FIG. 7 illustrates an example of this process. The graph 
shows speech bursts and silent periods for a typical call of 
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five minutes in duration. The GOS rating is calculated over 
a contiguoijs period of speech. The speech must conform to 
the rules of ANSI T1.221 which screen out invalid speech 
bursts, such as double talk and tones. In the example shown, 
5 a period of ten seconds of speech is used for GOS calcula- 
tions. The graph also shows how packet loss, delay and jitter 
may occur during call duration. The correlation between the 
GOS rating for a call and network performance is logged. A 
significant number of calls are measured using this procc- 
10 dure to gain a high confidence in the relationship between 
GOS rating and network performance. 

Since the voice GOS is an end-to-end measurement, 
certain filtering for the effects of the access portion of the 
voice IP connection, with regard to performance, are 
15 required. For example, calls should be grouped into specific 
sets determined by calling numbers which are known to be 
served by the same PSTN network equipment in order to 
ensure accurate GOS measurements. 

The embodiments of the invention described above are 
exemplary only. Changes and modifications to those 
embodiments may become apparent to persons skilled in the 
art. The scope of the invention is therefore intended to be 
hmited solely by the scope of the appended claims. 

I claim: 

^ 1 . A method for using In-service Non-intrusive Measuring 
Devices (INMD) for assessment of transmission quality in 
Internet Protocol (IP) telephony networks comprising the 
steps of: 

1) collecting a group of IP datagrams associated with a 
speech sample of an end-to-end IP telephony session 
from at least one IP interface point by identifying a 
packet flow associated with the IP telephony session; 

2) processing the IP datagrams and converting the data- 
2j grams into a format suitable for INMD processing; 

3) using an INMD process to assess a pluraUty of voice 
grade performance parameters related to the IP tele- 
phony session. 

2. A method as claimed in claim 1 wherein the step of 
40 using the INMD process to assess the voice grade perfor- 
mance includes a step of computing a voice Grad Of Service 
(GOS) perfonnance using a method specified in ATSI Tl LB 
566. 

3. A method as claimed in claim 2 further comprising a 
45 step of: 

4) calculating a percent Good or Better (%GOB) score 
relevant to the voice GOS performance. 

4. A method as claimed in claim 3 further comprising a 
step of: 

50 5) correlating the voice GOS performance to performance 
of the IP telephony network. 

5. A method as claimed in claim 1 wherein the IP 
datagrams collected in step 1 comprise H.323 frames encap- 
sulated in Realtime Transport Protocol (RTP), encapsulated 

55 in User Datagram Protocol (UDP), encapsulated in the IP 
datagram. 

6. A method as claimed in claim 1 wherein step 1 further 
comprises a step of smoothing out any delay variation in the 
speech sample using header information in the IP datagrams. 

60 7. A method as claimed in claim 1 wherein step 1 further 
comprises a step of computing a group of network perfor- 
mance parameters using header information in the IP data- 
grams, 

8. A method as claimed in claim 1 wherein step 2 further 
65 comprises a step of determiniog a speech compression 
algorithm used in the IP datagrams by examining data 
encapsulated in the packets. 
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9. A method as claimed in claim 1 wherein the step of 
collecting the IP datagrams of the speech sample is per- 
formed respectively at a far end IP interface point and a near 
end IP interface point. 

10. A method as claimed in claim 9 wherein the step of 
using the INMD to assess the converted IP datagrams 
collected from the far end IP interface point further com- 
prises a step of computing voice grade performance param- 
eters related to speech level and noise, and the step of using 
the INMD to access the converted IP datagrams collected 
from the near end IP interface point further comprises a step 
of computing voice grade performance parameters relating 
to echo path delay and loss. 

11. A method as claimed in claim 4 wherein step 5 further 
comprises: 

tabulating a pluraUty of performance data for the mea- 
sured end-to-end IP telephony connection as identified 
by a pair of source/destination addresses, the data 
including analogue voice parameters, the voice GOS 
and the IP network performance; and 

correlating the network performance and the analogue 
voice parameters using the tabulated data to verify a 
Service Level Agreement (SLA), and for use in net- 
work maintenance. 

12. A method as claimed in claim 1 wherein step 1 further 
comprises a step of storing IP source and destination address 
information associated with each IP datagram, and further 
comprises storing a datagram timestamp used for a post 
correlation analysis. 

13. A method as claimed in claim 7 further comprising a 
step of storing a timestamp for post correlation analysis. 

14. A method as claimed in claim 7 wherein the step of 
computing network performance parameters comprises 
computing delay, packet loss and delay variation using the 
header information, which includes a sequence number, 
timestamp and length information. 

15. A method as clainicd in claim 1 wherein step 2 further 
comprises a step of using an error mitigation process to 
remove an effect of errors and packet loss. 

16. A method as claimed in claim 1 wherein step 2 further 
comprises a step of inserting background noise during a 
silent period in the end-to-end IP telephony session. 

17. A method as claimed in claim 1 wherein step 3 further 
comprises a step of performing a process to active speech 
detection. 

18. A method as claimed in claim 1 wherein step 3 further 
comprises a step of performing a co-process for tones. 

19. A method as claimed in claim 1 wherein step 3 further 
comprises a step of performing a process for double talk 
detection. 

20. A method as claimed in claim 1 wherein step 3 further 
comprises a step of performing a co-process for echo 
cancellation. 

21. A method as claimed in claim 1 wherein step 2 
comprises a step of operating a Digital Signal Processor 
(DSP) to process the IP datagrams. 

22. A method as claimed in claim 6 wherein the step of 
smoothing out any delay variation comprises a step of using 
header information associated with the RTP protocol header. 

23. A method as claimed in claim 7 wherein the step of 
smoothing out any delay variation comprises a step of using 
header information associated with the RTP protocol header. 

24. An initial calibration process for calibrating an IP 
telephony measurement apparatus comprising the steps of: 

creating an IP datagram calibration file using speech 

samples having a known GOS; 
processing IP datagrams from the IP datagram calibration 

file using the IP telephony measurement apparatus to 
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convert the IP datagrams into data in a format suitable 
for INMD processing; 

processing the data using INMD functionality of the IP 
telephony measurement apparatus to determine a GOS 
5 value associated with the IP datagrams; 

comparing tie GOS value with a GOS associated with the 
speech samples used to create the IP datagram calibra- 
tion file, and 

adjusting the IP telephony measurement apparatus until 
the GOS values are equal, within a certain predefined 
Hmit. 

25. A method as claimed in claim 24 wherein the step of 
creating the IP datagrams comprises a step of creating the IP 
datagrams using an IP telephony terminal which is known to 
be good. 

26. A method as claimed in claim 25 fiirther comprising 
a step of using the IP telephony measurement apparatus in 
conjunction with a known speech sample having a known 
GOS and a related IP datagram file to calibrate both a far end 
and near end gateways when the IP telephony measurement 
apparatus is determined good. 

27. A method as claimed in claim 26 fiirther comprising 
a step of sending the IP datagram file to the far end gateway 

^ and looping the datagram file back using a four-wire ana- 
logue interface to return the datagram file to the measure- 
ment apparatus. 

28. An apparatus for assessment of IP telephony networks 
transmission quality comprising: 

30 an In-service Non-intrusive Measurement Device 
(INMD) processing function adapted to assess voice 
grade performance parameters in a connection oriented 
Time Division Multiplexer (TDM); and 
a processor adapted to convert a group of IP datagrams 

35 associated with an end-to-end IP telephony connection 
to data in a data format suitable for input to the INMD 
processing function for assessment of the voice grade 
performance parameters. 

29. An apparatus as claimed in claim 28 further compris- 
40 ing a data collector adapted to collect the IP datagrams by 

identifying a packet flow associated with an IF telephony 
session. 

30. An apparatus as claimed in claim 28 wherein the 
INMD processing function further comprises a function for 

45 computing a voice Grade Of Service (GOS) performance 
specified in ATSI Tl LB 566. 

31. An apparatus as claimed in claim 28 wherein the 
apparatus is co-located with an IP voice gateway. 

32. An apparatus as claimed in claim 28 wherein the 
50 apparatus is a stand-alone device in the end-to-end IP 

telephony connection. 

33. An apparatus as claimed in claim 30 further compris- 
ing a processor adapted to correlate the voice GOS perfor- 
mance to IP network performance. 

55 34. An apparatus as claimed in claim 30 wherein the 
converting processor is adapted to use header information in 
the IP datagrams to smooth out any delay variation in a 
speech sample and further adapted to compute a group of 
network performance parameters. 

60 35. An apparatus as claimed in claim 34 wherein the 
converting processor further comprises a Digital Signal 
Processor (DSP) to facilitate computations. 

36. An apparatus as claimed in claim 28 wherein the 
connection is linked to a far end IP interface point and a near 

65 end IP interface point of the IP telephony session. 

37. An apparatus as claimed in claim 36 wherein the 
INMD processing function is adapted to compute voice 
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grade performance parameters relating to speech level and 
noise from the converted IP datagrams collected from the far 
end IP interface point and further adapted to compute voice 
grade performance parameters relating to echo path delay 
and loss from the converted IP datagrams collected from the 
near end IP interface point. 

38. An apparatus as claimed in claim 30 wherein the 
INMD processing function further comprises a function 
adapted to calculate a percent Good Or Better (%GOB) 
score relevant to the voice GOS performance. 

39, An apparatus as claimed in claim 34 wherein the 
correlating processor is adapted to tabulate a plurality of 
performance data for the assessed end-to-end IP telephony 
connection as identified by a pair of source/destination 
addresses, the data including analogue voice parameters, the 
voice GOS and the IP network performance; and is further 
adapted to correlate the network performance and the ana- 
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logue voice parameters using the tabulated data to verify a 
Service Level Agreement (SLA) and for use in network 
maintenance. 

40. An apparatus as claimed in claim 34 wherein the 
converting processor is adapted to compute delay, packet 
loss and delay variation using header information that 
includes a sequence number, times tamp and packet length 
information. 

41. An apparatus as claimed in claim 28 wherein the 
converting processor is adapted to conduct an error mitiga- 
tion process to remove an effect of errors and packet loss. 

42. An apparatus as claimed in claim 28 wherein the 
converting processor is further adapted to conduct a process 
for an insertion of background noise during a silent period 
during the end-to-end IP telephony connection. 
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